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Abstract 

In 2011, Taiwan's Ministry of Education conducted a national-scale appraisal of 92 
CLIL programmes. However, we lack an effective model for examining by preci¬ 
sely how much improvement in the quality of the CLIL programmes will rise as 
a consequence of the increased language proficiency and the acquisition of dis¬ 
ciplinary knowledge. To gain greater insight into the relationship between the 
execution and appraisal results of CLIL and the facilitation of content and foreign 
language acquisition, we researched the stakeholders’ perceptions of and attitu¬ 
des towards CLIL in order to create a reference for the national appraisal results. 
Our aim was to collect both quantitative and qualitative data on the programme 
managers, teachers and learners in 12 CLIL programmes nationwide by way of a 
questionnaire survey and interviews. We assessed these data to answer our main 
research questions regarding the efficacy and effectiveness of employing CLIL edu¬ 
cation in higher education in Taiwan. In total, 53 undergraduates and postgradua¬ 
te CLIL students completed a self-designed questionnaire survey, investigating 
their perceptions of and attitudes towards CLIL education. In addition, interviews 
with CLIL programme managers and student focus-groups were also conducted 
to further probe their opinions on CLIL. The findings mainly revealed that the lear¬ 
ners’ satisfaction with the CLIL approach is greatly affected by their level of lan¬ 
guage proficiency. Our findings can significantly advance our understanding of 
the current situation of CLIL education and the likely effects of changing the cu¬ 
rricula and directions of delivering content and foreign language courses at the 
tertiary level in Taiwan. 
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Investigacion de la eficacia en el aprendizaje, manejo 
de dificultades y mejoras en educacion terciaria de los 
programas en AICLE (aprendizaje integrado de contenidos 
y lenguas extranjeras) en Taiwan: encuesta sobre las 
perspectivas de los agentes involucrados en la educacion 


Resumen 

En 2011, el Ministerio de Educacion de Taiwan realizo una evaluacion a nivel na- 
cional a 92 programas de aprendizaje integrado de contenidos y lenguas extran¬ 
jeras (AICLE). Sin embargo, carecemos de un modelo efectivo para examinar con 
exactitud el nivel de avance en la calidad de los programas de AICLE que tenga 
como consecuencia el aumento en la proficiencia en la lengua y la adquisicion 
de conocimiento en esta disciplina. Con elfin de entender mejor la relacion entre 
la ejecucion y los resultados de la evaluacion de AICLE y la facilitacion del conte- 
nido y la adquisicion de una lengua extranjera, se han investigado las percepcio- 
nes de los agentes involucrados y sus actitudes con respecto a AICLE, con el fin de 
tener referenda para los resultados de una evaluacion nacional. El proposito fue 
recoger datos cualitativos y cuantitativos de los directores de programas, profe- 
sores y aprendices de 12 programas de AICLE a nivel nacional por medio de una 
encuesta y entrevistas. Se analizaron estos datos para responder las preguntas 
de investigacion en relacion con la eficacia y eficiencia de la ensenanza por me¬ 
dio de educacion en AICLE en la educacion superior en Taiwan. En total, 53 estu- 
diantes de pregrado y postgrado en AICLE completaron una encuesta que indaga 
sobre sus percepciones y actitudes hacia la educacion en AICLE. Adicionalmente, 
tambien se hicieron entrevistas a grupos de enfoque conformados por directores 
y estudiantes de programas AICLE para confirmar sus opiniones acerca de AICLE. 
Los resultados revelaron, principalmente, que la satisfaccion de los aprendices con 
la metodologia AICLE se ve afectada, sobre todo, por sus niveles de proficiencia 
en la lengua. Nuestros resultados pueden aportar, significativamente, en nuestro 
conocimiento de la situacion actual de la ensenanza en CLIL y los posibles efec- 
tos en el cambio del curriculo y las directrices para impartir cursos de contenido 
y lengua extranjera en la educacion terciaria en Taiwan. 

Palabras clave: evaluacion de AICLE; Taiwan; educacion terciaria; agentes invo¬ 
lucrados en la educacion. 
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Pesquisa sobre a eficacia na aprendizagem, manejo 
de dificuldades e melhoras na educacao superior dos 
programas de Aprendizagem Integrada de Conteudos e 
de Lingua em Taiwan: enquete sobre as perspectivas dos 
agentes envolvidos na educacao 


Resumo 

Em 2011, o Ministerio da Educacao de Taiwan realizou uma avaliacao nacional a 
92 programas de Aprendizagem Integrada de Conteudos e de Lingua (AICL). No 
entanto, carecemos de um modelo efetivo para examinar com exatidao o nivel 
de avanco na qualidade dos programas de AICL que tera em consequencia do au- 
mento na proficiencia na lingua e da aquisicao de conhecimento nessa discipli- 
na. Com o objetivo de entender melhor a relacao entre a execucao e os resultados 
da avaliacao de AICL e a facilitacao do conteudo e da aquisicao de uma lingua es- 
trangeira, investigamos as percepcoes dos agentes envolvidos e suas atitudes a 
respeito da AICL a fim de ter referenda para os resultados de uma avaliacao na¬ 
cional. Nosso proposito foi coletar dados qualitativos e quantitativos dos diretores 
de programa, professores e aprendizes de 12 programas de AICL no ambito nacio¬ 
nal por meio de uma enquete e entrevistas. Analisamos esses dados para respon¬ 
der a nossas perguntas de pesquisa com relacao a eficacia e a eficiencia do ensino 
baseado na AICL na educacao superior em Taiwan. Em total, 53 estudantes de gra- 
duacao e pos-graduacao em AICL completaram uma enquete que questiona so¬ 
bre suas percepcoes e atitudes sobre a educacao em AICL. Alem disso, foram feitas 
tambem entrevistas a grupos de enfoque formados por diretores e estudantes de 
programas de AICL para confirmar suas opinioes sobre ela. Os resultados revela- 
ram principalmente que a satisfacao dos aprendizes com a metodologia AICL se 
ve afetada principalmente por seus niveis de proficiencia na lingua. Nossos re¬ 
sultados podem avancar significativamente o conhecimento da situacao atual do 
ensino em AICL e os possiveis efeitos na mudanca do curriculo bem como nas di- 
retrizes para ministrar cursos de conteudo e de lingua estrangeira na educacao 
superior em Taiwan. 

Palavras-chave: avaliacao de AICL; Taiwan; educacao superior; agentes envol¬ 
vidos na educacao. 
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INTRODUCTION 1 

Content and Language Integrated Learning (CLIL) is a generic term, refer¬ 
ring to an innovative educational approach in which a subject is taught 
in an additional language (Lasagabaster & Sierra, 2010). CLIL is always du¬ 
al-focused on both content and language. Depending on the model used, its 
aims can be very subtle in terms of helping learners understand the point 
of learning a language and developing their 'can-do' attitude as language 
learners (Marsh, 2009). This purpose is crucial for EFL contexts such as Tai¬ 
wan or Japan where English is mainly used in classrooms rather than in 
the students’ real lives, and where many EFL learners are eagerly attempt¬ 
ing to advance their English proficiency. On the other hand, its aims can be 
subliminal in having both language and content teachers "change teach¬ 
ing practices, or socially-oriented, in boosting levels of harmony between 
inter-ethnic groups” (Marsh, 2009:1). This purpose is also vital for those 
contexts in which CLIL programmes have a combination of internation¬ 
al and local students such as in the cases researched in the present study. 

Contributed to by the strong driver of socio-economic globalisation, 
the number of CLIL programmes has increased rapidly in the last decade, 
and CLIL has become a mainstream form of education in many European 
countries (Maljers, Marsh, & Wolff, 2007; Gefaell & Unterberger, 2010). Simi¬ 
larly, in tertiary education in Taiwan, the establishment of CLIL programmes 
has been encouraged by the educational authorities, mainly the Ministry 
of Education (MOE),to push the goal of internationalised higher education 
forward. The preeminent additional language taught by CLIL programmes 
is English (Lasagabaster & Sierra, 2010). In order to evaluate the effective¬ 
ness and management of offering CLIL education, the MOE conducted its 
first large-scale appraisal in 2011, which is exceptional in that it was a na¬ 
tionwide appraisal conducted by the top educational authority of the coun¬ 
try rather than by teachers, schools, researchers, or local governments, as 
in the European context. 


1 Parts of the sections including the introduction, literature review, and background to 
the study are derived from the author’s previous works and research grant proposals 
(Yang, 2014 a.b., 2015, 2016 a.b., Yang & Gosling, 2013, 2014) and are partially modified 
for the present report. 
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Previous studies on evaluating CLIL education have mainly been 
conducted from three dimensions: firstly an examination of the effec¬ 
tiveness of CLIL education by comparing learners’ progress in the (addi¬ 
tional) language proficiency before and after the implementation (e.g., 
Connon, 2007; Dalton-Puffer, 2008, 2009); secondly, an evaluation of the 
CLIL implementation, mainly in secondary schools in European contexts, 
by applying a sole research method (e.g., Jappinen, 2005); and thirdly the 
evaluation of CLIL education mainly initiated by the micro-involvers, 
namely, CLIL teachers and researchers (e.g., Perez-Canado, 2012). 

However, apart from European contexts, investigations of implement¬ 
ing and evaluating CLIL programmes on a large scale are apparently rare¬ 
ly documented in the literature (Perez-Canado, 2012), in particular, in Asian 
EFL situations where CLIL education is increasingly obtaining the attention 
of educational authorities who hope to establish close connections to glo¬ 
balisation by integrating English, the most dominant foreign language, 
into disciplines at the tertiary level. Therefore, this study aims to bridge 
the gap by examining how EFL learners view the new learning approach 
of CLIL based on their expectations and experiences with a quantitative 
survey, and probing CLIL learners’ and practitioners’ deeper attitudes and 
perceptions of CLIL during qualitative interviews to see if their opinions 
correspond to the official results and previous studies. 

LITERATURE REVIEW 1 

As Coyle (2007b) suggested, effective CLIL takes place “through progres¬ 
sion in knowledge, skills and understanding of the content, engagement 
in associated cognitive processing, interaction in the communicative con¬ 
text, the development of appropriate language knowledge and skills as 
well as experiencing a deepening intercultural awareness" (p. 550) and 
thus much current research focuses on evaluating the relationship be¬ 
tween input and outcome in both content knowledge and linguistic 
competence, while still other studies spotlight the evaluation of CLIL pro¬ 
grammes as a whole in various settings, and identify their potential prob¬ 
lems and the difficulties of implementation. 
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In the first instance, a number of studies in European contexts have 
examined the effectiveness of using the CLIL approach to teach subjects 
other than language courses at different levels of education. For instance, 
in Jappinen's (2005) study, the results reveal that the students in the ex¬ 
perimental CLIL group had more significant cognitional development in 
learning mathematics and science than those in the control group, and 
the research confirms that "the Finnish CLIL environments in public main¬ 
stream Li education have succeeded” (p. 161). However, she also warned that 
abstract topics may not be well suited for young CLIL learners in her context. 

Similarly, Burston and Kyprianou (2009) also concluded that their 
CLIL programmes in teaching architecture, biology and law in a Cyprus 
university were holistically successful in that the participants were very 
motivated and satisfied with the programmes, the departments were sat¬ 
isfied, and most importantly, the students’ grades had improved. 

In contrast to the above two studies, Dalton-Puffer (2008) examined 
the outcome of CLIL education from the perspectives of language compe¬ 
tencies and use in the classroom. She argued that "CLIL significantly en¬ 
hances the language skills of the broad group of students whose foreign 
language talents or interest are average” (p. 5) where the favourably affect¬ 
ed language competencies include receptive skills, vocabulary, morphology, 
creativity, risk-taking, fluency, quantity and emotive/affective outcomes. 

In addition, in CLIL classrooms, teachers tend to provide elaborate 
feedback and additionally reserve more space and time for students’ com¬ 
ments and interaction. At the end of her paper, Dalton-Puffer (2008) pin¬ 
pointed the fact that investigation of students’ perceptions of how they 
view their CLIL teachers’ (including content teachers and EFL teachers) lan¬ 
guage problems and corrections in instruction is still lacking, so the pres¬ 
ent research aims to attend to this concern. 

Coonan (2007), on the other hand, studied the outcomes of both lan¬ 
guage competence and non-language effects in CLIL classrooms through 
teachers’ self-observation and introspection. Her results are similar to Dal- 
ton-Puffer’s (2008) in that she found that learners’linguistic receptive skills 
are promoted more than their productive skills. Besides, she emphasised 
that CLIL positively affects the way students learn the content because 
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extra care is taken by teachers to help them overcome the hurdles and to 
nurture language growth through the content. 

Furthermore, a great number of studies have also confirmed the positive 
improvement in learners' linguistic production in a CLIL context, particularly 
in terms of their receptive skills and lexical richness (see Alonso, Grisalena, & 
Campo, 2008; Dalton-Puffer, Huttner, Schindelegger & Smit, 2009; Infante, 
Benvenuto & Lastrucci, 2008; Loreanc-Paszylk, 2007, 2009; Lorenzo, Casal & 
Moore, 2010; Olavide, 2009; Trento, 2008; Zabore, 2008), except for in Airey's 
(2009) study where the students who were taught in dual languages per¬ 
formed better than those taught exclusively in English. 

Nevertheless, the claimed dual effects of CLIL are also questioned in 
some studies, and some disadvantages have been unexpectedly generat¬ 
ed in some European contexts. For example, Seikkula-Leino (2007), who 
researched CLIL learners’ affective performance and attitudes, noted that 
although pupils in CLIL programmes were more motivated to study and 
to use the foreign language (FL), they sometimes felt incompetent and in¬ 
adequate in learning, a situation brought about by the complexities and 
difficulties of learning through a FL. CLIL caused low self-esteem regarding 
the students’ FL ability. Bruton (2011a. b.) not only questioned the results of 
improved FL ability in the experiments comparing students’ performance 
in CLIL and non-CLIL groups, but raised critical concerns about the real ef¬ 
fect of the development of the dual focus for average students (not select¬ 
ed or elite students) in CLIL education. Furthermore, he also highlighted 
the concern of quality control in CLIL, including CLIL teacher training. 

In addition to the European cases, a number of CLIL studies have 
also been conducted in Asian contexts, but their attitudes are more cau¬ 
tious. For example, in Japan the implementation of CLIL has aroused con¬ 
cerns that FL may replace the priority of learning their mother tongue for 
young learners (Sasajima, Ikeda, Hemmi, & Reilly, 2011). Likewise, a num¬ 
ber of studies (Lee & Chang, 2008; Mackenzie, 2008; Marsh & FJood, 2008) 
have also contended that as a potentially new teaching approach in Asian 
contexts, CLIL has motivational advantages, develops multiple intelligenc¬ 
es, and acts as an enabler for Asian EFL learners to achieve positive atti- 
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tudes towards the relevance of English, but still, CLIL teacher preparation 
is apparently insufficient in this area. 

Feng (2010) also described the diverse models of CLIL adopted in the 
greater Chinese circle (Hong Kong, Mainland China, Macau and Taiwan). 
He argued that CLIL exists as a continuum from language-driven to con¬ 
tent-driven ends, and each context is mapped diversely on this continuum 
according to differences in cultural, governmental or economic factors. Sim¬ 
ilar discussion of the probabilities of implementing CLIL in Taiwan and Chi¬ 
na has confirmed that, in contrast to the traditional ELT approaches, CLIL 
can be an alternative for accommodating students' subject knowledge and 
linguistic competence, although there is still the issue of training qualified 
CLIL teachers as in other contexts (Hou, 2007; Lo, 2007; Luo, 2006). Besides, 
the nature of the different subjects taught in English, the English acquired 
in the English language classes, and the students' English proficiency en¬ 
try level can also greatly affect the teaching efficacy in Asian CLIL educa¬ 
tion, as in the case of Hong Kong (Marsh, Hau, & Kong, 2000). To the best 
of my knowledge, currently, the only empirical study investigating CLIL 
education in Taiwan is Yang and Gosling’s research (2013). After examin¬ 
ing a single highly-recommended CLIL programme, they concluded that 
CLIL teacher development is an urgent need in Taiwan, further consider¬ 
ation of whether all students in EFL settings can equally learn or thrive in 
a CLIL programme is warranted, and accommodation should be made for 
language support. However, compared to the rich CLIL research document¬ 
ed in European contexts, the practical outcomes of CLIL education in Asian 
contexts, in particular Taiwan, are still relatively understudied. 

Regarding the evaluation of CLIL in various settings, Perez-Canado 
(2012) conducted an extensive review of the cases across European coun¬ 
tries. She concluded that, not surprisingly, a great majority of the CLIL pro¬ 
grammes have been championed in Europe, but unfortunately the fact is 
that these programmes are full of methodological flaws in their design. 
Most of the evaluations are stand-alone quantitative studies which do not 
take dynamic variables or statistical analysis into consideration. Thus, she 
advises that future studies evaluating CLIL should rigorously investigate 
"whether the gains observed are truly ascribed to CLIL practices" (p. 16). 
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So far, most of the experimental studies used learners’ language output 
and knowledge competency as the measures to establish the effectiveness 
of the programmes. However, students, as "the target group and intend¬ 
ed beneficiary of CLIL education, have at this point not had much voice in 
the development of and discourse on CLIL in general” (Dalton-Puffer et al., 
2009). Students' attitudes and perceptions of CLIL education are relatively 
understudied, except for a few studies (e.g., Dalton-Puffer et al., 2009; Ge- 
faell & Unterberger; 2010; Yassin, Marsh, Tek, & Ying, 2009). 

Although CLIL is still in its infancy in Taiwan, several studies have 
been conducted by the author and colleague to unveil its current imple¬ 
mentations and effects. They, for instance, studied why a CLIL programme 
would be highly recognised or not recommended by Taiwan's MOE after 
its first official appraisal of all the CLIL programmes in Taiwan universi¬ 
ties (Yang & Gosling, 2013, 2014). They concluded that CLIL learners' atti¬ 
tudes towards CLIL education can be a key factor, affecting the results of 
the programme appraisal. Those who hold a relatively positive attitude 
towards the CLIL approach may help the programme pass the apprais¬ 
al and make it highly recommended by the authorities, and vice versa. In 
addition, Yang found that proficient CLIL learners tend to use indirect lan¬ 
guage learning strategies relatively more frequently in order to adapt to 
the highly collaborative learning environment of tertiary CLIL education 
(Yang, 2016 b). His studies (Yang, 2014a, 2015), furthermore, confirmed that 
CLIL undergraduates did outperform their non-CLIL counterparts in both 
content achievement and linguistic outcomes, and thus also showed high¬ 
er mobility and employability in the globalised job market. These studies, 
so far, have clearly evidenced the positive benefits of CLIL education real¬ 
ised in an Asian EFL context. 

However, in Taiwan, although CLIL programmes are encouraged by 
the MOE, currently an objective and systematic evaluation of both students’ 
and teachers' performance in CLIL education is still seriously lacking. Thus, 
the issue of whether or not the quality of CLIL lessons can be controlled is 
doubted by the public (Chen, 2012). In other words, the issue of how stake¬ 
holders such as students or programme managers evaluate their CLIL edu¬ 
cation is generally overlooked. Thus, to bridge the gap, this study attempted 
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to combine both qualitative and quantitative methods to evaluate CLIL ed¬ 
ucation along with considering the stakeholders’variables, and to triangu¬ 
late the evaluation results from various sources of data by comparing and 
contrasting a number of CLIL programmes in Taiwan. Hopefully, the study 
can highlight implications for managing CLIL programmes, and provide 
practical suggestions for how to evaluate students’ performance in terms 
of both content and FL in EFL contexts in Taiwan. 

To be specific, this research mainly explores: firstly, how the CLIL 
learners at tertiary level view the effects of CLIL education; secondly, how 
the stakeholders of the CLIL programmes, namely, the managers and learn¬ 
ers, view the claimed dual benefits of CLIL. To be specific, the research fo¬ 
cuses on the following questions: 

What are the students' perceptions of and attitudes towards CLIL 
education? 

What are the differences or similarities in the views of the students 
and managers of the implementations of the CLIL education in Taiwan? 

METHOD 

A mixed-methods research framework 

As suggested by Perez-Canado (2012), the research design and methodolo¬ 
gy of future studies on CLIL should combine mixed methods, adopt trian¬ 
gulation, and employ multivariate procedures. Hence, the present study 
used both quantitative and qualitative methods to collect and analyse 
data, as the study’s focus lent itself to a mixed methods approach using 
qualitative and quantitative approaches in combination, and drew upon 
the advantages of each. This method can serve to provide a better under¬ 
standing than either approach alone (Creswell & Plano, 2007). Using the 
notation proposed by Morse (1991,2003), this is a OUAN-^OUAL explanato¬ 
ry mixed-methods design. The results are discussed using the quantitative 
results in combination with the qualitative data to enhance the analysis 
and further illuminate some of the findings. This methodology allows the 
integration of data and responses from the various stakeholders, from 
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the MOE, through the programme directors, the teaching staff and the stu¬ 
dents as outlined below. 

A quantitative approach was employed with the students who were 
given a Chinese close-ended questionnaire with a Likert scale five-point 
response (from 5, strongly agree to 1, strongly disagree) designed for the 
purpose of the study. The question items in the questionnaire are divid¬ 
ed into two major sections and five sub-categories, that is, linguistic im¬ 
provement, content knowledge learning, classroom practices, supports 
and strategies, and affective attitudes. Before the students completed the 
questionnaire, it had been piloted by one L2 teacher, one Li teacher and a 
number of students in the selected programmes to ensure its comprehen¬ 
sibility and readability. The reliability of Cronbach's alpha reaches .856. 

The qualitative data came from several sources in addition to a refer¬ 
ence to the MOE appraisal report. Interviews were held with the teaching 
staff, where each teacher and programme director was individually inter¬ 
viewed for about half an hour in their respective first languages. Chinese 
interviews were transcribed into English and checked by independent 
translators. In addition, the students responded to open-ended questions 
on the given questionnaire. 

The researched context 

In a globalised society, politics, culture and economics are becoming close¬ 
ly dependent on each other, and higher education, which is responsible for 
cultivating professionals and transmitting professional knowledge, is also 
facing competitiveness and challenges from other countries. Consequent¬ 
ly, to facilitate cultural exchange, to publicise the features of Taiwanese 
higher education, to increase the standards of tertiary education, to solid¬ 
ify the competitiveness of universities, and to broaden college students' 
global vision and language proficiency, the MOE of Taiwan has long en¬ 
couraged institutes in higher education to set up courses which use English 
as a medium of instructing disciplinary knowledge. The final purposes of 
these programmes are to recruit foreign students to study in Taiwan, to 
increase the competitiveness of Taiwanese higher education, and to devel¬ 
op professionals with the ability of international mobility. 
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In addition to the numerous CLIL courses, there are 92 CLIL degree 
programmes in 29 universities 2 conferring bachelor, master and doctoral 
degrees. The earliest programmes were established in 1979 and the latest 
were set up in 2010. All of the programmes are expected to use English as 
the only language of instruction in the classroom. The MOE provides in¬ 
centives of up to 10 million NT dollars per university to encourage the es¬ 
tablishment of more CLIL degree programmes, while also conducting a 
national-scale appraisal of all the programmes to ensure their quality in 
October 2011. The 92 programmes were classified into three different rank¬ 
ings, namely highly recommended, recommended, and not recommended. 

Sampling CLIL programmes and participants 

This research sampled the programmes based on several categories. Firstly, 
all of the current CLIL programmes were divided into undergraduate (UG) 
and postgraduate (PG) programmes. Then, the results of the national ap¬ 
praisal were used to further classify the two major categories into highly 
recommended (HR), recommended (RD), and not recommended (NR) pro¬ 
grammes, which resulted in six categories in total. Next, one programme 
(G) was randomly selected as the study context from each of these six cate¬ 
gories; therefore, six CLIL programmes were investigated in this study. Ap¬ 
proximately ten learners in each programme were invited to complete the 
questionnaire, and the return rate reached 90% (i.e., N=54 in total). Of the 
participants, 38 were undergraduate students while the rest were post¬ 
graduates (including master and doctoral students) from six different uni¬ 
versities island-wide (5 comprehensive, 1 polytechnic, 2 national, 4 private), 
all of whom are Taiwan nationals. A majority of them (40.7%, N=22) were 
in the final year of their programme, the first year (7.4%, N=4), the second 
year (33.3%, N=i8), and the third year (18.5%, N=io); 81.5% (N=44) of them 
came from normal senior high schools while only 18.5% (N=io) had studied 
at a vocational high school. Normally, senior high school students’ English 
competency is higher than that of polytechnic students in Taiwan; therefore, 


2 CLIL degree programmes include bachelor, master and doctoral programmes where all 
disciplinary courses are conducted in the major foreign language i.e. English; indivi¬ 
dual CLIL courses offered by universities are not included in this study. 
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CLIL programmes are more commonly implemented in the former than in 
the latter. Hence, over half of the respondents (57.4%) had reached equiv¬ 
alent of the CEFR B2 level in an English proficiency test (over TOEIC 750) 
while 40.7% had reached CEFR Bi (TOEIC 500-750), and only 1 participant 
had lower competency (less than TOEIC 500). Generally, the present partic¬ 
ipants had better command of English compared to their non-CLIL peers, 
and had achieved the benchmark of English language proficiency required 
by most Taiwanese universities. 

Finally, the directors (D) and also the teachers of the six programmes 
were interviewed together with four randomly-selected students (S) who 
helped complete the questionnaire survey from each programme. Total¬ 
ly, 24 students, making up six focus groups, joined the interviews for this 
study. Since the CLIL education investigated in the present study was fo¬ 
cused on degree-based programmes rather than departments, all the pro¬ 
gramme managers (or chairs) and teachers came from other departments 
to support the programme, so there were no full-time teaching faculty 
Similarly, all the programme chairs (4 males, 2 females) were Taiwanese 
teachers with proficient English skills due to their education background 
in English-speaking countries. All of them, during the research stage, had 
taken the position for one term (i.e., 3 years). The student interviewees 
constituted four undergraduate groups and two postgraduate groups. All 
the interviews lasted for about one hour and were conducted in Manda¬ 
rin Chinese to facilitate contribution and avoid any misunderstandings. 

Data analysis 

To answer research questions 1, a Chinese close-ended questionnaire (see 
Appendix 1 for the English version, Yang & Gosling, 2013) on a five-point Likert 
scale was designed, and the collected data were analysed with the help of the 
statistical software, SPSS 14.0. In addition to the descriptive analysis, t-tests 
and one-way ANOVA were also performed to gauge any significant differenc¬ 
es in the variables. Then, to answer research question 2, further interviews 
with the directors, teachers and students were conducted. The interviews 
were recorded and then transcribed into English by the researcher and 
two research assistants together with the help of NS colleagues’ proof- 
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reading. Then, all the English transcriptions were processed with the as¬ 
sistance of the qualitative data analysis software, WeftODA. The study 
applied grounded theory, which is extensively used to analyse qualitative 
data by coding data with similar concepts into various categories (Glaser 
& Strauss, 1967). The coding was checked and confirmed by the research 
assistants of this study. 

RESULTS AND DISCUSSION 

Descriptive results of the questionnaire survey 

This following part answers research question i: how Taiwan CLIL learn¬ 
ers perceive the effects of the current CLIL education, and is divided into 
five sub-categories. Linguistic improvement includes question items 1, 2, 
3,4, and 5; content knowledge learning: 6,7, 8, and 9; classroom practices: 
23, 24, 28, 29, and 32; supports and strategies: 10,11,12,15,16,17,18,19, 20, 21, 
26, 30, 32, 34, and 35; and affective attitudes: 13,14, 22, 25, 31, 33, 36, 37, and 
38 (Yang & Gosling, 2013). 

Tables 1 to 5 display the results of the perceived linguistic improve¬ 
ments under CLIL education. Surprisingly, different from the previous stud¬ 
ies, a majority of the present participants generally did not show high 
agreement with the increment in linguistic skills under the CLIL approach. 
CLIL learners usually have better performance in receptive skills than in 
productive skills, which has been extensively documented in previous re¬ 
search (see Yang, 2014a for a detailed discussion). Yet, the current partic¬ 
ipants, in contrast, did not hold similar attitudes. It is assumed that the 
participants' overall English proficiency was already high; thus, it is dif¬ 
ficult for them to perceive any significant change. In addition, it is likely 
that teaching linguistic elements is not stressed as equally as instructing 
content knowledge in Taiwan CLIL programmes; hence, the participants 
may not be clearly aware of the improvements in their English language 
skills. CLIL is sometimes criticised as an elitist approach (Burton, 2011a. b.) 
and Taiwan CLIL programmes also purposefully recruit highly proficient 
English learners due to the fear that lower English achievers may not be 
able to adapt well to courses instructed only in English. Ironically, this 
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selective recruitment seems to lead to a lack of general agreement regard¬ 
ing linguistic improvement as a result of CLIL education. 


Table i. My writing proficiency has improved (Oi) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

1 

1-9 

i -9 

i -9 


2.00 

13 

24.1 

24.1 

25.9 


3.00 

27 

50.0 

50.0 

75-9 


4.00 

12 

22.2 

22.2 

98.1 


5.00 

1 

1-9 

i -9 

100.0 


Total 

54 

100.0 

100.0 



Table 2. My reading proficiency has improved (O2) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

4 

7-4 

7-4 

7-4 


2.00 

23 

42.6 

42.6 

50.0 


3.00 

21 

38.9 

38.9 

88.9 


4.00 

5 

9-3 

9-3 

98.1 


5.00 

1 

i -9 

i -9 

100.0 


Total 

54 

100.0 

100.0 



Table 3. My speaking proficiency has improved (O3) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

14 

25.9 

25.9 

25.9 


2.00 

17 

31-5 

31-5 

57-4 


3.00 

17 

31-5 

31-5 

88.9 


4.00 

6 

11.1 

11.1 

100.0 


Total 

54 

100.0 

100.0 



Table 4. My listening proficiency has improved (O4) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

19 

35.2 

35.2 

35.2 


2.00 

20 

37.0 

37.0 

72.2 


3.00 

12 

22.2 

22.2 

94-4 


4.00 

3 

5-6 

5-6 

100.0 


Total 

54 

100.0 

100.0 
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Table 5. My overall English proficiency has improved (O5) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

11 

20.4 

20.4 

20.4 


2.00 

17 

31-5 

31-5 

51-9 


3.00 

19 

35.2 

35.2 

87.0 


4.00 

7 

13.0 

13.0 

100.0 


Total 

54 

100.0 

100.0 



The following Tables 6 to 9 exhibit the participants' opinions on learn¬ 
ing content knowledge via the additional language, English. However, the 
results show a different picture from the previous discussion. The major¬ 
ity of the respondents admitted to having difficulties understanding the 
courses delivered in English. In other words, half of the students indicated 
that learning content knowledge through an additional language is not as 
easy as they had believed, even though their command of English was gen¬ 
erally rather good. There are various possible reasons for this. For instance, 
learning content and language simultaneously brings students double 
pressure, which may hinder the acquisition of content knowledge com¬ 
pared to learning in Chinese-speaking classrooms. Another reason might 
be the different purposes of using English in the classroom. Most Taiwan¬ 
ese EFL learners learn English for the purpose of taking tests, and the En¬ 
glish curriculum is designed based on learning the language for general 
purposes, which does not sufficiently prepare learners for using English 
for academic purposes (EAP) at tertiary level; neither are there many EAP 
courses provided to bridge this gap in the CLIL programmes. Although CLIL 
is not regarded as providing language courses, and CLIL and ESP (English 
for specific purposes) are seemingly two extremes of the language learn¬ 
ing curriculum, additional ESP courses can be offered as supplements and 
supports for CLIL learners (Yang, 2016 a), in particular in higher education 
where CLIL students have to learn academic disciplines via very academic 
English which clearly has some language conventions which must be fol¬ 
lowed but which are seldom taught in Taiwan's English learning context. 
Thus, it is advisable that tailor-made ESP courses be designed and provid¬ 
ed as additional support for CLIL learners. 
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Table 6 .1 have no difficulty reading articles ( 06 ) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

3 

5-6 

5-6 

5-6 


2.00 

23 

42.6 

42.6 

48.1 


3.00 

16 

29.6 

29.6 

77.8 


4.00 

10 

18.5 

18.5 

96.3 


5.00 

2 

37 

37 

100.0 


Total 

54 

100.0 

100.0 



Table 7 .1 have no difficulty writing my content knowledge (O7) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

1 

1-9 

1-9 

i -9 


2.00 

15 

27.8 

27.8 

29.6 


3.00 

22 

40.7 

40.7 

70.4 


4.00 

12 

22.2 

22.2 

92.6 


5.00 

4 

74 

74 

100.0 


Total 

54 

100.0 

100.0 



Table 8 .1 have no difficulty orally expressing my content 
knowledge ( 08 ) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

3 

5-6 

5-6 

5-6 


2.00 

22 

40.7 

40.7 

46.3 


3.00 

20 

370 

370 

83.3 


4.00 

6 

11.1 

11.1 

94-4 


5.00 

3 

5-6 

5-6 

100.0 


Total 

54 

100.0 

100.0 



Table 9. Generally, I can understand most CLIL courses (O9) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

12 

22.2 

22.2 

22.2 


2.00 

26 

48.1 

48.1 

70.4 


3.00 

11 

20.4 

20.4 

90.7 


4.00 

4 

74 

74 

98.1 


5.00 

1 

i -9 

i -9 

100.0 


Total 

54 

100.0 

100.0 
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Regarding the third category, supports and strategies, Tables 10 to 
14 show the results as follows. First, in line with the previous discussion, 
over half of the participants showed a need for extra supportive language 
courses to assist their CLIL learning. Although CLIL claims a dual-focused ap¬ 
proach, catering for both content and language learning, content teaching 
is usually overemphasised in relation to language teaching. It is therefore 
argued that when CLIL is implemented in secondary or primary schools, 
the courses are less academic and extra language support to master the 
courses is also thus less necessary. Yet, in tertiary CLIL, nearly all the cours¬ 
es are academic-oriented and the English required to master the disciplines 
is more complicated, but also conventionalised with predictable peculiar¬ 
ities. Thus, extra academic English courses may be beneficial for lessening 
learners' anxiety and pressure of acquiring content knowledge via the addi¬ 
tional language in CLIL contexts. Without appropriate scaffolding, learners 
may translate English into Chinese in order to learn the subject in the CLIL 
classroom, which is evidenced in the results of question items 28 and 29. 

Second, the participants did not expect practitioners' timely use of 
the learners’ mother tongue to help their learning and facilitate their un¬ 
derstanding in CLIL classrooms, as shown in Table 14. In Taiwan, CLIL is 
classed as a high-exposure CLIL mode (Yang & Gosling, 2013, 2014) as En¬ 
glish is often used for over 60% of the instructional time. Some local CLIL 
practitioners and learners may misinterpret that CLIL should be instruct¬ 
ed using English only, or at least as much as possible; however, appropri¬ 
ately using the Li (mother tongue) is helpful and is in fact encouraged in 
CLIL classrooms to keep learners motivated and engaged in CLIL learn¬ 
ing (Lo, 2015), thus increasing the effect of CLIL education. Hence, timely 
code-switching while instructing or explaining difficult concepts in the 
disciplines should be adopted by local CLIL practitioners, as it is believed 
to be able to facilitate the understanding of the content knowledge and 
increase the satisfaction with the programme. 

In the category of examining teachers’ actual CLIL practices in class, a 
number of questions were asked. Table 15 lists the overall results. In general, 
the participants agreed relatively less with their teachers' actual practice 
in class. First, the present participants would prefer Taiwanese teachers to 
native English-speaking teachers to teach CLIL courses (Oil, O12). They also 
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Table 10 .1 need no extra English courses to increase 
my English ability (O23) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

9 

16.7 

16.7 

16.7 


2.00 

16 

29.6 

29.6 

46.3 


3.00 

12 

22.2 

22.2 

68.5 


4.00 

15 

27.8 

27.8 

96.3 


5.00 

2 

37 

37 

100.0 


Total 

54 

100.0 

100.0 



Table 11 .1 need extra English courses to increase 
my English ability (O24) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

2 

37 

37 

37 


2.00 

16 

29.6 

29.6 

33-3 


3.00 

15 

27.8 

27.8 

6l.l 


4.00 

15 

27.8 

27.8 

88.9 


5.00 

6 

11.1 

11.1 

100.0 


Total 

54 

100.0 

100.0 



Table 12. The CLIL programme helps me think in English (O28) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

14 

25.9 

25.9 

25.9 


2.00 

24 

44-4 

44-4 

70.4 


3.00 

10 

18.5 

18.5 

88.9 


4.00 

6 

11.1 

11.1 

100.0 


Total 

54 

100.0 

100.0 



Table 13 .1 tend to convert Chinese into English in CLIL courses (O29) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

5 

9-3 

9-3 

9-3 


2.00 

18 

33-3 

33-3 

42.6 


3.00 

14 

25.9 

25.9 

68.5 


4.00 

11 

20.4 

20.4 

88.9 


5.00 

6 

11.1 

11.1 

100.0 


Total 

54 

100.0 

100.0 
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Table 14. Teachers need to use Chinese in a timely manner 
to teach CLIL courses whenever needed (O32) 




Frequency 

Percent 

Valid Percent 

Cumulative Percent 

Valid 

1.00 

17 

31-5 

31-5 

31-5 


2.00 

25 

46.3 

46.3 

77.8 


3.00 

5 

9-3 

9-3 

87.0 


4.00 

6 

11.1 

11.1 

98.1 


5.00 

1 

i -9 

i -9 

100.0 


Total 

54 

100.0 

100.0 



showed less agreement with native English speaking teachers being more 
capable of teaching CLIL subjects (O20,O21). It is believed that local teach¬ 
ers share the same cultural and language backgrounds with the learners 
so interaction with each other would be easier. In addition, postgraduate 
students may receive many tutorials with their teachers to discuss their 
dissertations. Teachers who speak the same Li are thus more popular with 
postgraduate students as their supervisors. 

Second, a majority of the respondents did not agree that the teach¬ 
ing methods are different in CLIL class (O10), which pinpoints a major prob¬ 
lem in the current Taiwan CLIL education. That is, most CLIL teachers are 
content teachers who have a good command of English, but unfortunate¬ 
ly lack proper training of teaching language. Thus, they tend to replicate 
the way they teach content in their Li in the CLIL context, and make no ob¬ 
vious attempt to adjust their English to increase content comprehension, 
which is also evidenced in O30 and O35. In other words, insufficient CLIL 
teacher training leads to this duplication without proper adjustments to 
the teaching methods. This insufficiency also causes dissatisfaction with 
the assessments in CLIL courses. CLIL is dual-focused and differs from tra¬ 
ditional education approaches; thus, assessing both language achievement 
and content learning outcomes is necessary, but this is often neglected by 
CLIL practitioners (Massler, 2010). Similarly, the results of question items 17, 
18 and 19 also indicate that traditional lectures and group discussion are still 
the most common teaching methods used in the current CLIL programmes, 
but they are not very popular with the students. All these concerns mirror 
the necessity of offering CLIL teacher training for practitioners. 
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However, nearly 90% of the respondents did not expect teachers’ cor¬ 
rection of their errors (O34). Error correction may prevent learners from en¬ 
gaging in linguistic production, and discourage them from studying in a 
CLIL programme, for fear of losing face in public. Indeed, at the initial stage 
of CLIL education, fluency is more desired than accuracy in terms of learn¬ 
ers' linguistic production. The respondents held a divided attitude towards 
O26. They showed an uncertain attitude towards which language is pre¬ 
ferred to learn content knowledge, Li or English. CLIL is still a rather new 
educational approach and thus not much positive or empirical evidence 
can be found locally, except for Yang’s research (2014a, 2015). It is argued 
that learners are likely to have more positive attitudes towards CLIL once 
more local studies have confirmed its effectiveness and benefits. 


Table 15. Classroom practices (%) (N=54) 


Scale 

0. item 

5 

4 

3 

2 

1 

10 

3-7 

11.1 

27.8 

42.6 

14.8 

11 

3-7 

5-6 

31-5 

27.8 

31-5 

12 

3-7 

25.9 

42.6 

16.7 

11.1 

15 

1-9 

1-9 

3-7 

5 ° 

42.6 

16 

i -9 

0 

29.6 

5 i -9 

16.7 

17 

0 

11.1 

38.9 

40.7 

9-3 

18 

3-7 

9-3 

29.6 

42.6 

14.8 

19 

7-4 

13 

35.2 

3 i -5 

13 

20 

13 

13 

27.8 

3 i -5 

14.8 

21 

3-7 

27.8 

50 

18.5 

0 

26 

7-4 

22.2 

40.7 

24.1 

5-6 

30 

0 

16.7 

24.1 

5 ° 

9-3 

34 

0 

5-6 

11.1 

53-7 

29.6 

35 

0 

3-7 

29.6 

44-4 

22.2 


Table 16 concludes the last category of the questionnaire, i.e. affec¬ 
tive attitudes, and presents the overall results. First, the reason why the 
students decided to study in a CLIL programme may be their parents’ en¬ 
couragement or their interest (O13 and O14). According to the MOE’s policy, 
Taiwan CLIL programmes are established not only to attract international 
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students but also to develop local students’ content knowledge and lan¬ 
guage proficiency, which is supposed to help increase their future employ- 
ability and mobility in the globalised job market, and this non-linguistic 
benefit of CLIL education has also been confirmed in Yang’s research (2015). 
Thus, it is self-evident that parents would encourage students to study in 
a CLIL programme. 

However, after studying a CLIL programme for a period of time, it 
seems that it does not increase most students’ motivation to learn either 
English or the content knowledge. It is possible that CLIL education is not 
as wonderful as they may have expected. Thus, in their overall judgement, 
they did not show a sufficiently supportive attitude to recommend this in¬ 
novative approach to other students. It seems that the present CLIL learners, 
in general, are not very satisfied with the claimed benefits of CLIL educa¬ 
tion. Probably, the fact that they did not perceive a significant increase in 
their English proficiency is one of the reasons. Yet, in Yang’s (2014a) study, 
he pointed out the interesting fact that CLIL learners tend to devalue the 
actual increment of their language achievements and content knowledge 
performance while in fact showing an increase in both areas according to 
tests. This also echoes the previous issue, namely the use of appropriate 
assessments in CLIL education. 


Table 16. Affective attitudes (%) (N=54) 


Scale 

0. item 

5 

4 

3 

2 

1 

13 

3-7 

16.7 

27.8 

27.8 

24.1 

14 

31-5 

33-3 

22.2 

13 

0 

22 

0 

13 

37 

42.6 

7-4 

25 

1-9 

27.8 

27.8 

29.6 

3-7 

3 i 

0 

11.1 

31-5 

48.1 

9-3 

33 

0 

7-4 

24.1 

48.1 

20.4 

36 

7-4 

5-6 

40.7 

33-3 

13.0 

37 

0 

0 

24.1 

59-3 

16.7 

38 

0 

5-6 

35.2 

42.6 

16.7 
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Significant differences by variables 

Differing from the descriptive data in section 4.1, the following discussion 
focuses on the significant differences caused by different variables. In the 
present study, question items regarding the demographic information of 
the questionnaire were used as the variables to gauge the statistical signif¬ 
icance among various groups by performing t-tests and one-way ANOVA. 

First of all, only two question items showed a significant difference 
between female and male learners, i.e. O16, satisfaction with teachers' as¬ 
sessments in CLIL courses (t=-.76i, <.oi) and O17, the preference of teachers' 
lectures in the CLIL classroom (t=-i.i75, <.oi). Male learners showed signifi¬ 
cantly higher satisfaction with teachers' assessments and lectures than the 
female students did. It is possible that, since female EFL learners general¬ 
ly have a more positive attitude towards English learning and have high¬ 
er English proficiency than their male peers (Kobayahsi, 2002), they would 
naturally care more about how they are assessed. Therefore, when English 
performance is not as highly stressed and properly assessed as the content 
knowledge is, as in the present context, they would feel dissatisfied. Sim¬ 
ilarly, female CLIL learners may expect more diverse teaching methods to 
be used in the CLIL classroom, and thus also showed a reluctant attitude 
if teachers’ lectures still dominated as they do in traditional courses de¬ 
livered in the Li. However, this issue may be worth further investigations. 

There is only one item showing significant difference between un¬ 
dergraduate and postgraduate CLIL learners, i.e. improvement in writing 
skills (t=.640, <.05). The undergraduates had significantly higher satisfac¬ 
tion with this than the postgraduates did. It is assumed that English writ¬ 
ing skills are more important for postgraduate study, and learners would 
show greater dissatisfaction if they felt that CLIL failed to improve their 
English writing skills, in particular the skills required for dissertation writ¬ 
ing. This result indicates that when a CLIL programme is being planned, 
considering which linguistic elements would be more practically required 
by different learners is essential. For instance, CLIL implemented in post¬ 
graduate study should place much emphasis on integrating English writ¬ 
ing with content learning, while listening and reading skills may be more 
highly required in undergraduate study. 
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For the variable of which year they were studying, no significant 
difference was found, which indicates that the respondents’ concerns 
and attitudes towards CLIL education are generally consistent across the 
years of study. However, for the variable of their previous major in senior 
high school (senior high school without a specific major, vocational high 
school with a non-language major and with a language major), a num¬ 
ber of items show statistical significance among the groups as shown in 
Table 17. In general, the CLIL students who came from senior high schools 
had a more negative attitude towards CLIL education. They were less sat¬ 
isfied with the improvement in their English skills and with the teachers’ 
teaching methods in CLIL courses; thus, they showed less motivation and 
involvement in their CLIL courses, and also believed that Taiwanese teach¬ 
ers have difficulty teaching CLIL programmes. In contrast, those learners 
with a vocational high school background had a more welcoming and ac¬ 
knowledging attitude towards CLIL education, but also expressed greater 
need for extra English courses. The likely reasons might be similar to those 
discussed previously. That is, the higher English achievers may have a high¬ 
er expectation of CLIL increasing their English proficiency, but they easily 
become dissatisfied if the linguistic elements are not equally addressed in 
the courses. On the other hand, students with intermediate or lower En¬ 
glish proficiency may regard CLIL education as one way to improve their 
English abilities, so they showed more positive attitudes towards it. Again, 
the implementation of a CLIL course or programme should take contextual 
differences into consideration and require necessary adaptation to fit the 
local settings. This can also explain why CLIL, used as an umbrella term, 
exists in many different versions worldwide (Coyle, 2008). 

The variable of learners’ English proficiency led to the most signif¬ 
icant differences in this study (see Table 18). Over half of the participants 
had a high command of English (CEFR, B2 level or above) while the rest 
were at the Bi level (with one student below). Those who had better En¬ 
glish proficiency showed significantly higher agreement with their own 
performance and with native English-speaking teachers’ capability in 
CLIL courses, but in contrast, lower satisfaction with the teachers’ perfor¬ 
mance and the CLIL approach overall; thus, it is obviously difficult for them 
to make a recommendation for future students. Contrarily, those with 
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Table 17. Items with significance across various previous 
majors in high school 


Question item 

One-way ANOVA 

O4. Improvement in listening skills 

(F( 2 : 5 i)= 3 - 978 , P<- 05 ) 

O5. Improvement in overall English proficiency 

(F(2:5l) = 5.272,P<.Ol) 

O10. Teachers using different teaching methods 

(F(2:5l)=7-ll8, P<.oi) 

O22. Students showing high involvement 

(F(2:5i)=2.449,P<.05) 

O23. No extra English course needed 

(F(2:5i)=5.6gi, P<.oi) 

O25. Increment in motivation to learn English 

(F(2:5l) = 6.48o, Pc.oi) 

O27. Taiwanese teachers’ difficulty teaching CLIL 

(F (2:51)—6.232, P<.oi) 


lower English proficiency were more motivated to study in their CLIL pro¬ 
gramme, acknowledging its effects on helping increase their future employ- 
ability and recommending the approach to prospective students, although 
they had relatively more difficulties understanding the CLIL course mate¬ 
rials. They tended to convert English into Chinese in CLIL class and also re¬ 
quired additional language courses to bridge the gap in comprehending 
English-delivered lectures. Moreover, they preferred local teachers to teach 
CLIL courses probably because local teachers are more empathetic and un¬ 
derstand learners' needs and difficulties when learning with an innova¬ 
tive approach (Arva & Medgyes, 2000; Medgyes, 1992). 

In the last variable, the time duration of studying English, only one 
item was found to have significance across the groups, i.e. O33. CLIL ben¬ 
efits to future job prospects (F( 2:5i)=3-662, P<. 05). It was found that those 
who had studied for longer in the programme showed higher agreement 
with this benefit than junior CLIL learners did. The former learners were 
about to graduate from the programme and had to find a job, so the du¬ 
al-focused CLIL education, developing both content knowledge and lan¬ 
guage competency, was expected to be helpful for their job hunting in 
a globalised market. Indeed, in Yang's (2015) research, he argues that in¬ 
creasing CLIL learners' mobility and employability are the two evidenced 
non-linguistic benefits of CLIL education. 

A short conclusion to this questionnaire survey is that the imple¬ 
mentation of CLIL education should be contextualised, depending on the 
learners' needs and customised curricula to accommodate both content 
and language learning. 
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Table 18. Items with significance across various levels 
of English proficiency 


Question item 

One-way ANOVA 

O5. The increase in overall English proficiency 

(F(2:5l) = 6.006,P<.0l) 

06. No difficulty reading articles 

(F(2:5l) = 8.030,P<.0l) 

08. No difficulty orally expressing content knowledge. 

(F(2:5i)=4-523, P<-°5) 

O9. Understand most CLIL courses 

(F(2:5i)=4.828, P<.05) 

O10. Teachers using different teaching methods 

(F(2:5l) = 3.224,P<.05) 

Oil. Native English-speaking teachers preferred 

(F(2:5i)=4.665,P<.05) 

O13. Interested in CLIL 

(F(2:5 1 )=3.8i5,P<.05) 

O18. Group discussion in CLIL courses preferred 

(F(2:5l) = 3.291,P<.C>5) 

O20. English-speaking teachers more capable of teaching CUL 

(F(2:5i)=4.o84, P<.05) 

O22. Students showing high involvement 

(F(2:5l) = 5.2C>7, P<.oi) 

O23. No extra English courses needed 

(F(2:5 1 )=4.877,P<.05) 

O24. Extra English courses needed 

(F(2:5l) = 5.510,P<.0l) 

O25. Increment in motivation to learn English 

(F(2:5 1 )=3.8i5,P<.°5) 

O26. Taiwanese teachers preferred to teach CLIL 

(F(2:5i)=3.8u, P<.05) 

O28. CLIL helping thinking in English 

(F(2:5i)=3.66o, P<.05) 

O29. Converting Chinese into English in CLIL courses 

(F(2:5i)=7.697, P<.ooi) 

O33. CLIL beneficial to future job prospects 

(F(2:5 1 )=4-744,P<.05) 

O38. Recommending CLIL to others 

(F(2:5l) = 8.010,P<.00l) 


Feedback from the interviews 

From CLIL programme managers and teachers 

In total, 6 programme directors (also CLIL practitioners) were interviewed 
for the present study, and their qualitative contribution can be discussed 
under the following headings. 

Dual benefits of CLIL. All of the interviewees expressed the opinion 
that CLIL has two major advantages. From the university perspective, CLIL 
brings more international students to study in Taiwan's tertiary education 
institutions, which is relatively more important for private universities. In¬ 
ternationalisation is one of the important indicators to appraise a univer¬ 
sity, and the number of international students is an essential criterion for 
evaluating a university’s internationalisation, which would greatly affect 


LACLIL / ISSN: 2011-6721 / Vol. 9 N0.1 January-June 2016 / doi:io.5294/ladil.20i6.9.i.4 / 64-109 


89 























An Investigation of Learning Efficacy, Management Difficulties and Improvements in Tertiary CLIL... 


the annual budget or subsidy a university can obtain from the MOE. From the 
students’ perspective, CLIL creates an international learning environment for 
local students, which means that students can acquire intercultural knowl¬ 
edge and learn English without travelling or studying abroad. One director 
said, "The number of international students we can recruit is unlimited and 
the implementation of CLIL programmes can help me pass the MOE evalua¬ 
tion in terms of internationalisation.” 

Insufficient and unstable CLIL teachers: This is the major concern 
raised by most interviewees. They argued that CLIL is the right approach 
and should be implemented, but the problem is that teachers might not 
be ready for this change. Qualified CLIL teachers are still rare. Most of the 
current CLIL teachers are either native English-speaking content teachers 
or local content teachers with proficient English competency. However, 
CLIL seems to only mean lectures given in English to them; therefore, the 
accommodation of both content and language teaching is always over¬ 
looked. This probably may be the major reason making the present learn¬ 
ers dissatisfied with CLIL education. Overreliance on native speakers also 
leads to another problem, that is, "they are relatively unstable. I mean, they 
usually come to Taiwan for a short term and may terminate their contract 
anytime, which brings much uncertainty for the course director to arrange 
the future courses," as another programme director commented. 

Problem-based learning oriented: Due to the novelty of the CLIL ap¬ 
proach, traditional lectures may not be able to suit learners’needs and expec¬ 
tations. Thus, group discussion, class activities, collaboration, and interaction 
are the common features of a CLIL classroom. However, compared to a simi¬ 
lar course delivered in Mandarin Chinese, these CLIL practices require much 
longer pre-class preparation by the teachers, so most universities are will¬ 
ing to pay double the salary for those CLIL teachers. One teacher remarked, 
"Unless you are also interested in and enthusiastic about CLIL education, 
preparing a CLIL course is really high pressure and causes anxiety. Honestly, 
double the pay is not a very attractive incentive. The time and effort spent 
on preparing the course is unbelievably immense.” 

Unattended accuracy in English production: Nearly all the directors 
and teachers expressed the opinion that accuracy in learners’ English pro¬ 
duction is not what they are concerned about; in contrast, they attend much 
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more to the accuracy in communicating content knowledge, not wheth¬ 
er the content knowledge is presented grammatically correctly or not. 
Hence, they hardly ever offer feedback on language use to learners, and 
also seldom evaluate learners’ English performance in assessments. Iron¬ 
ically, receiving teachers’ feedback on their language use is what many 
learners yearn for in CLIL class. It is argued that this gap may distort the 
claimed dual-focuses of CLIL education and decrease learners’ motivation 
and satisfaction with CLIL. 

The enhancement of global vision and confidence: Since most of the 
CLIL programmes embrace international students and local students in 
the same classroom, they offer chances for local students to learn how to 
interact with the international students, which greatly helps in develop¬ 
ing their intercultural awareness and communication, and builds up their 
confidence in using English for communication. According to one director’s 
observation, “CLIL learners comparatively have more confidence in express¬ 
ing their opinions in English, and the programme helps them to expand their 
global views as they spend time interacting with their international peers 
very often during and after class." One director was very proud of her stu¬ 
dents' performance and achievements in the CLIL programme and even 
claimed that CLIL will replace English departments in Taiwan tertiary ed¬ 
ucation soon as she believes that CLIL learners perform better at content 
knowledge and language proficiency while English majors only focus on 
language skills. 

Preparing qualified CLIL teachers: Although the interviewees ex¬ 
pressed positive comments on the implementation of CLIL in Taiwan, 
they all suggested that it is indispensable to train qualified CLIL teachers 
immediately as the popularity of CLIL programmes is growing quickly in 
Taiwan’s universities. They suggested that workshops addressing how to 
integrate language teaching into content teaching should be held, which 
is particularly urgent for content teachers as they usually have no previ¬ 
ous formal training on language teaching. One director said, “A workshop 
on howto teach CLIL is not only needed but should also be provided period¬ 
ically for a long-term period. It is a bit ridiculous that the University some¬ 
times holds a workshop for simply two days and hopes that we, the content 
teachers, can become qualified CLIL teachers all of a sudden." 
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All in all, compared to the preceding survey results, CLIL directors and 
teachers hold a much more positive attitude towards the effect of CLIL ed¬ 
ucation. However, if teachers’ anticipations and learners’ expectations of 
CLIL are not aligned, complaints and dissatisfaction would unavoidably 
occur. Hence, communication between the two parties and modification 
of the programmes are essential to increase the future implementation of 
CLIL and ensure its claimed benefits. 

From CLIL learners 

In total, six focus groups of students were invited to join the interviews. 
Their opinions are categorised as the following headings, some of which 
are similar to the author’s previous findings (Yang & Gosling, 2013, 2014). 

‘ Asianalised’ CLIL: Many students expressed the opinion that they 
supposed there would have been many native English-speaking peers in 
class, but the fact was that most of their foreign peers come from Asian 
countries, in particular the South-East Asian region where the first lan¬ 
guage is not English. Ideally, all the CLIL programmes would have half 
native English-speaking students and half local students to create an in¬ 
ternationalised learning environment according to the MOE expecta¬ 
tion, but in fact native English speakers are still very rare in the current 
programmes. Thus, students may feel that the actual situation is totally 
different from what they had been told, and then disappointment and dis¬ 
satisfaction may occur. One student commented that “all the internation¬ 
al students in my programme come from a single South-East Asian country 
and their English proficiency is much lower than ours. I cannot see that I can 
learn any English from them." 

Deficient in CLIL teaching faculty: 'Teacher and teaching quality' is an¬ 
other major student doubt about the current CLIL programmes. A majority 
of the interviewees indicated their preference for native English speakers 
as CLIL teachers and complained about the local non-native English speak¬ 
ing teachers’ English accuracy, fluency and pronunciation, which would 
sometimes hinder understanding of the lectures. Although the differen¬ 
tiated CLIL classroom discourse between native and non-native speakers 
has been discussed in some research (e.g., Dafouz, Nunez, & Sancho, 2007; 
Llinares-Garcia & Romero-Trillo, 2008), it is difficult to argue who, native 
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or non-native teachers, is more qualified to teach CLIL courses. One inter¬ 
viewee commented that "Taiwanese teachers have difficulties delivering the 
course in English but they know our learning difficulties and can offer help. 
However, if we don’t understand something, native teachers only explain it 
once again in English and we still cannot get it.” Besides, the interviewees 
argue that those who can speak fluent English are not necessarily quali¬ 
fied CLIL teachers because many of them have no training in how to teach 
English. Thus, the dual-focused programme would sometimes end with 
only one focus, i.e. content knowledge. 

The timely intrusion ofLi and language feedback: As discussed in the 
preceding sections, learners’ Li can play an important role in CLIL educa¬ 
tion (Lo, 2015) and the interviewees also expressed a similar opinion that 
Li can be appropriately used to facilitate understanding. “Sometimes we 
need Chinese translation for difficult terminology and concepts in class; oth¬ 
erwise, we will be stuck there and cannot move on," remarked one student. 
In addition, they argued that they expected some feedback on their lan¬ 
guage use so that they can improve it. However, feedback should be gen¬ 
eral, and not too specific or frequent. One learner said, “If teachers correct 
each of my mistakes or errors in English, I think I would refrain from using 
English next time. This would demotivate me.” 

Progressive English receptive skills: Differing from their responses in 
the questionnaire survey, many of the interviewees agreed that their English 
proficiency had improved due to their CLIL education, in particular, their re¬ 
ceptive skills, i.e. vocabulary, listening, and reading, as evidenced in the lit¬ 
erature (e.g., Aguilar & Rodriguez, 2012; Dalton-Puffer, 2008). The materials 
students used in CLIL courses are authentic English language textbooks, and 
they are also expected to do a lot of reading after class; therefore, their read¬ 
ing speed and vocabulary size is expanded. However, they also hoped that 
an ESP course, teaching terminology and reading skills, would be offered 
before the CLIL course in order to shorten their time of adaptation. As one 
student remarked, “Teachers often use some professional terms in class but 
we cannot understand what they mean. So, we spend time looking up the 
meanings after class, but we actually already know these terms in Chinese. 
So, if teachers can provide us with Chinese translations of the terminology 


LACLIL / ISSN: 2011-6721 / Vol. 9 N0.1 January-June 2016 / doi:io.5294/ladil.20i6.9.i.4 / 64-109 


93 



An Investigation of Learning Efficacy, Management Difficulties and Improvements in Tertiary CLIL... 


in advance, this will reduce our wrong guessing and facilitate our content 
comprehension.” 

Divided opinions about the effect of CLIL: Regarding the overall eval¬ 
uation of the CLIL approach, the respondents held a divided attitude. It 
was found that learners from a highly-recommended programme gener¬ 
ally liked CLIL and would recommend it for future students, while those 
from programmes that were not recommended held a relatively neg¬ 
ative attitude towards the effect of studying in a CLIL programme, and 
were hesitant to make recommendations. These responses are similar to 
the author's previous findings in a case study (Yang & Gosling, 2013,2014) 
that students’ satisfaction and the appraisal result of a CLIL programme 
are closely related. Furthermore, not all disciplines in universities are suit¬ 
able to be conducted with a CLIL approach. For instance, disciplines in the 
humanities or regarding local features may not be adequately taught us¬ 
ing the CLIL approach. 

CONCLUSION AND IMPLICATIONS 

Conclusion of the research 

This research investigated the effect of implementing CLIL education at 
the tertiary level in Taiwan. The research adopted a mixed-method re¬ 
search design to study the questions. The research instruments included a 
self-designed questionnaire and in-depth interviews with CLIL programme 
directors and learners. In total, 52 undergraduate and postgraduate CLIL 
learners island-wide were invited to join the questionnaire survey, while 
six programme directors and teachers and six focus groups of CLIL learn¬ 
ers joined the semi-structured interviews. In the descriptive analysis, the 
results show that the present CLIL learners apparently do not have very 
high agreement or satisfaction with the claimed benefits of their CLIL ed¬ 
ucation. The major cause may come from the imbalance in the teaching of 
the content and language areas. Usually, content teaching is highly stressed 
but linguistic elements are not, which makes the learners perceive no in¬ 
crement in their language proficiency, and thus they feel that the dual-fo¬ 
cuses of CLIL are not equally achieved. However, in the interviews with the 
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CLIL directors and teachers, they showed a very positive and welcoming 
attitude towards CLIL. They believed that CLIL brings many advantages to 
both universities and students, but they also expressed one major concern, 
that is, the preparation of qualified CLIL teachers for the popularly-growing 
programmes at the tertiary level island-wide. In contrast with the responses 
expressed in the questionnaire survey, the interviews with the CLIL learners 
showed a slightly different attitude. In general, they acknowledged the in¬ 
crement in linguistic skills, in particular the receptive skills, preferred na¬ 
tive English-speaking teachers, and developed intercultural awareness. In 
contrast to their less positive responses shown in the descriptive analysis, 
the learners expressed a more positive attitude towards the effect of CLIL 
education in the interviews. 

Pedagogical implications 

The present research also offers the following pedagogical implications. 
First, communication should be well built between programme providers 
and CLIL learners. The results indicate that there is a gap regarding the ef¬ 
fect and benefits of CLIL education between these two groups of stakehold¬ 
ers. The former hold positive attitudes towards CLIL while the latter do not. 
Any educational innovation should be mutually communicated, understood 
among all the stakeholders and then implemented smoothly. CLIL, a new 
educational approach, required the involvement of the authorities, univer¬ 
sities, programme directors, learners and their parents to make it a success. 
Hence, good communication with all the stakeholders about what CLIL is and 
how it differs from traditional approaches is indispensable. If learners per¬ 
ceive that they are placed in an educational experiment without knowing 
what CLIL is, or if they are told how great CLIL is and what they will achieve, 
they would show great dissatisfaction with CLIL if the claimed benefits are 
not sensed or realised. 

Next, teachers are a vital factor affecting the success or failure of CLIL 
education. Both the learners' and teachers' opinions show that there is a 
lack of qualified CLIL teachers in Taiwan's tertiary education sector. Most of 
the programme providers use the easiest way to staff the teaching faculty 
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that is, CLIL teachers are either local content teachers with proficient En¬ 
glish or native English-speaking content teachers. Very few of them have a 
background in English language teaching (ELT). Hence, it is suggested that 
the programme providers offer potential CLIL teachers periodic training in 
CLIL education, in particular, the theories of ELT and how ELT can be well 
integrated with their content teaching. In addition, since the popularity 
of CLIL is growing dramatically in Taiwan’s universities island-wide, some 
'CLIL Centres’ (in Northern, Central, Southern and Eastern Taiwan) can be in¬ 
stituted to be in charge of training certified CLIL teachers, providing teach¬ 
ers with resources and support, conducting CLIL research and exchanging 
experiences with other neighbouring countries where CLIL is also rapidly 
gaining in popularity, such as Japan or Hong Kong. 

Furthermore, since CLIL teaching is always dual-focused, CLIL as¬ 
sessment is supposed to be dual-focused in the classroom, too. Too often, 
CLIL practitioners over-emphasise the assessment of content knowledge 
while overlooking the assessment of learners’ linguistic performance. One 
major reason is that the content teachers may not have the appropriate 
knowledge of ELT assessment, and the assessment of CLIL is especially 
different and complicated (Massler, 2010), so assessing leaners’ linguistic 
performance seems purposefully avoided. Yet, CLIL learners hope to know 
not only if they have learned the content knowledge, but also how much 
their English proficiency has progressed as a result of their CLIL education. 
Indeed, CLIL assessment should accommodate both elements and again 
proper training on how to assess learners’ performance in both content 
knowledge and language competency is needed. 

Lastly, appraising the effect of managing CLIL programmes should 
be multi-dimensional and contextualised. In the first nation-wide CLIL ap¬ 
praisal, the indicators mainly focused on the curriculum structure and ad¬ 
ministrative support; however, the teaching and learning performance in 
the CLIL context were not included as indicators. Hence, it is argued that 
in future appraisals, practitioners’ practice in the classroom and learners’ 
performance should also be evaluated, as these two dimensions reflect 
the core values of this innovative approach. Besides, the standards of CLIL 
appraisal could be amended in accordance with various CLIL settings. The 
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focuses of the appraisal should be differentiated, depending on the status 
of the programme providers, i.e. national vs. private universities and com¬ 
prehensive vs. polytechnic universities. Different programme providers 
have various purposes of setting up CLIL programmes, and the sources of 
learners are also diverse, with different entry levels of English proficien¬ 
cy. Catering to both contextual diversities and learners' differences in ap¬ 
praisals can help avoid the criticism of CLIL being an elitist approach. After 
all, one suit cannot fit all. 

Limitations and suggestions for future research 

Since the present research may be one of the very few studies investigat¬ 
ing the implementation and effect of the CLIL approach at the tertiary level 
in Taiwan, some future studies can be done to complement it. First, inter¬ 
national students' opinions can be examined. They are not all native En¬ 
glish speakers, and in fact most are also non-native English speakers like 
the present participants, and are mainly from Southeast Asian countries. 
How they see the actual effect of CLIL can provide another perspective on 
its implementation in Taiwan. Next, due to the small size of the current 
sample, and in order to generalise the findings, more participants should 
be invited to join future research. The CLIL learners from polytechnic uni¬ 
versities seemed to be more satisfied with CLIL education, so they may be 
able to provide better reasons for why CLIL has become popular and suc¬ 
cessful if more of them are included in a future study. Finally, to better un¬ 
derstand why there is reluctance about the adoption of CLIL, it is suggested 
that researchers investigate CLIL practitioners’ actual practices in the class¬ 
room. Classroom observations may unveil the real teaching performance 
and learning outcomes in class, which would help researchers clearly iden¬ 
tify how content and language teaching is executed in the classroom and 
what kinds of supports teachers and learners may need in order to imple¬ 
ment CLIL successfully. 
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APPENDIX 1: THE ENGLISH VERSION QUESTIONNAIRE 

Students’ Perceptions and Attitudes towards Content and Language Inte¬ 
grated Learning 

CLIL: A professional content course taught in English 

Background information 


1. Gender 

□Female 

□Male 


2. Degree 

□ B.A. 

□ M.A 


3. Nationality 

□Taiwanese 

□ International 


4. Grade 

□ 1st year 

□ 2nd year 

□ 3rd year 

□ 4th year 

5. High school major 

□Related 

□ Languages 

□Normal 

6. English proficiency (TOEIC) 

□ <500 

□ 500-750 

□ >750 

7. Duration of learning English 

□ 1-6 yrs 

□7-12 yrs 

□ 13 yrs 


B> After studying this CLIL programme, to what extent do you agree the fol¬ 
lowing statements? 


(5: strongly agree <-> i: strongly disagree) 


1. 

My writing proficiency is increased. 

□ 5 ^D4>03 %D2 >Oi 

2. 

My reading proficiency is increased. 

□ 5 >D4>D3>D2 >Di 

3 - 

My speaking proficiency is increased. 

□ 5 ^4^3 >D2 >Di 

4 

My listening proficiency is increased. 

□ 5 nD 4>D3 >02 >ni 

5 - 

Overall English proficiency is increased. 

□ 5 ^4^3 %02 >Di 

6. 

I have no difficulty in reading articles. 

□ 5 >D4>D3>D2 >Di 

7 - 

I have no difficulty in writing my content 



knowledge. 

□ 5 nD 4>D3 >02 >Di 

8. 

I have no difficulty in orally expressing my 



content knowledge. 

□ 5 >D4>D3>D2 >Di 

9 - 

Generally I can understand most CLIL courses. 

□ 5 ^D4>03 >D2 >Di 

10. 

Teachers use different methods in instructing 



CLIL courses. 

□ 5 ^4^3 >02 >Di 

11. 

I prefer native English-speaking teachers to teach 



CLIL courses. 

□ 5 '.□4>D3 >D2 nDi 

12. 

I prefer Taiwanese teachers to teach CLIL courses. 

□ 5 -.□4>03 >02 >Di 

13 - 

I chose this programme because I am interested 



in CLIL. 

□ 5 '.□4>D3 >D2 >Di 
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14. 

15 - 

16. 

17. 

18. 

19. 

20. 

21. 

22. 

23. 

24. 

25 - 

26. 

27. 

28. 

29. 

30. 

31. 

32. 


33 - 

34 - 


35 - 


36. 


My parents persuaded me to study CLIL programme. 

□ 5 ' 

^□4- 

,□3 

>□2 

>□1 

English is used more than 60% in CLIL courses. 

□ 5 ' 

>□4 ■ 

'□3 

>□2 

>□1 

I am satisfied with teacher’s assessment in CLIL 






courses. 

□ 5 ' 

>□4- 

,□3 

>□2 

>□1 

I prefer teacher’s lectures in CLIL courses. 

□ 5 ' 

*□4- 

,□3 

>□2 

>□1 

I prefer student’s group discussion in CLIL courses. 

□ 5 ' 

>□4- 

'□3 

>□2 

>□1 

I prefer student’s individual oral presentation in 






CLIL courses. 

□ 5 ' 

>□4- 

>□3 

>□2 

>□1 

I perceive native English-speaking teachers to be 






more capable of teaching CLIL courses. 

□ 5 ' 

^□4 ■ 

'□3 

>□2 

>□1 

I perceive Taiwanese teachers to be more capable 






of teaching CLIL courses. 

□ 5 ' 

>□4- 

>□3 

>□2 

>□1 

I show high involvements in CLIL courses. 

□ 5 ' 

^□4- 

,□3 

>□2 

>□1 

I need no extra English courses to increase my 






English ability 

□ 5 ' 

^□4 ■ 

,□3 

>□2 

>□1 

I need extra English courses to increase my 






English ability. 

□ 5 ' 

^□4- 

,□3 

>□2 

>□1 

CLIL programme increases my motivation of 






learning English. 

□ 5 ' 

^□4 ■ 

,□3 

>□2 

>□1 

I prefer teachers to use Chinese in teaching 






CLIL courses. 

□ 5 ' 

^□4- 

,□3 

>□2 

>□1 

Taiwanese teachers have difficulty in teaching CLIL. 

□ 5 ' 

>□4 ■ 

>□3 

>□2 

>□1 

CLIL programme helps me think in English. 

□ 5 ' 

^□4 ■ 

,□3 

>□2 

>□1 

I tend to convert Chinese into English in CLIL courses. 

□ 5 ' 

>□4- 

>□3 

>□2 

>□1 

Teachers significantly use different methods in 






teaching CLIL courses. 

□ 5 ' 

>□4 ■ 

'□3 

>□2 

>□1 

CLIL programme can increase my motivation of 






learning content subjects. 

□ 5 ' 

>□4- 

>□3 

>□2 

>□1 

Teachers need to use Chinese timely to teach CLIL 






courses whenever needed. 

□ 5 ' 

>□4 ■ 

'□3 

>□2 

>□1 

CLIL programme is beneficial to my future job. 

□ 5 ' 

^□4 ■ 

,□3 

>□2 

>□1 

I prefer teachers to provide me immediate linguistic 






feedback on my language errors. 

□ 5 ' 

^□4- 

,□3 

>□2 

>□1 

Teachers intentionally use simplified English to 






teach CLIL courses. 

□ 5 ' 

^□4 ■ 

,□3 

>□2 

>□1 

My family believe CLIL programme is beneficial to 






my future job. 

□ 5 ' 

^□4- 

,□3 

>□2 

>□1 
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37. Generally, I like this CLIL programme. CI5 '.□4 >D3 >Di 

38. I would recommend this CLIL programme to others. III5 -.□4>D3 %D2 >Di 

39. Please write down what you have gained or lost in studying this CLIL pro¬ 
gramme. 


40. Please write down any comments about this CLIL programme. 


Thank you for your precious time and generous contribution! 

Source:from Yang & Gosling (2013). 
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